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Abstract 

We derive an energy bound for inertial Hegselmann-Krause (HK) systems, 
which we dehne as a variant of the classic HK model in which the agents can 
change their weights arbitrarily at each step. We use the bound to prove the 
convergence of HK systems with closed-minded agents, which settles a conjecture 
of long standing. This paper also introduces anchored HK systems and show their 
equivalence to the symmetric heterogeneous model. 


1 Introduction 

The Hegselmann-Krause model of multiagent consensus has emerged as a “model or¬ 
ganism” for opinion dynamics [9] . In an HK system, a collection of n agents, each one 
represented by a point in evolves by applying the following rule at discrete times: 
move each agent to the mass center of all the agents within unit distance. It has been 
shown that the system always freezes eventually inmniEsi 11119]. While the model 
has been the subject of numerous studies m El El m El E] and much is known about 
its convergence rate, its heterogeneous variant remains a mystery |2il ESI EEl EH EH- 
In that model, each agent can choose its own radius of conhdence. In the HK model 
with closed-minded agents, all of the agents have radius either 1 or 0. While extensive 
simulations have pointed to the convergence of that system diiiniiiTiEi], a proof has 
remained elusive. This open question has been described by a leading researcher as 
one of the outstanding gaps in our understanding of opinion dynamics [8]. This paper 
resolves this issue by settling the conjecture in the affirmative: HK systems with closed- 
minded agents always converge. Our proof entails making the problem a special case 
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of a much broader class of dynamical systems, the inertial HK systems (more on which 
below). 

The relaxation time of the original HK model has been shown to be in any fixed 
dimension [6], a bound later improved to a polynomial bound in both n and d [1]. For 
the particular case d = 1, a bound of 0{n^) was established in |T6], which was lowered to 
0(n'^) in [20] and then to 0{n^) in [1]. The model can be generalized in various ways, its 
ultimate expression being the grand unihed model of influence systems [7], in which each 
agent gets to pick its neighbors by following its own distinct, arbitrary criteria. Oddly, 
even the most seemingly innocuous modihcations of the original HK model have stumped 
researchers in the held. This is the case of HK systems with closed-minded agents, where 
any agent’s radius of conhdence is either 0 or 1. To prove that these systems always 
converge, we introduce the more general inertial HK systems and establish a bound on 
their kinetic 2-energy. We also introduce the anchored variant of HK systems and prove 
that it is equivalent to the symmetric heterogeneous model. This fairly surprising result 
sheds new light on the convergence properties of these systems. 

1.1 Inertial HK systems 

Instead of being required to move to the mass center of its neighbors at each step, each 
agent of an inertial HK system may move toward it by any fraction of length; setting 
this fraction to zero makes the agent closed-minded, which means that it remains frozen 
in place. Formally, the system consists of n agents represented by points xi(t),, x^it) 
in at time t = 0,1, 2, etc. Two agents i and j are said to be neighbors if they are 
within unit distance: \\xi(t) —Xj(t )\\2 < 1. When the time t is understood, the neighbors 
of i form a set we denote by Nf, these sets form an undirected communication network 
Gt with a self-loop at each of the n nodes. The dynamics of the system is specihed by 

Xi{t + l) = {l-X)xi{t) + -^J2^j(^)^ ( 1 ) 

' *' jeVi 

where A G [0,1] is called the inertia. Not only A need not have the same value for all 
the agents, but it can be reset to a different value with each application of (II]). In this 
way, we can select any agent to be closed-minded by setting their inertia to 0. We can 
also retrieve the original HK model by turning all the inertias to 1. In its full generality, 
however, an inertial HK system is not deterministic. We tackle the issue of convergence 
by turning our attention to their kinetic s-energy. The concept was introduced in ^ 
as a generating function for studying averaging processes in dynamic networks. It is 
dehned as follows: 

n 

K{s) = “ ^iit)\\ 2 - 

t>0 i=l 

We provide an upper bound for the case s = 2. 
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Theorem 1.1. The kinetic s-energy of an n-agent inertial HK-system whose inertias 
are uniformly bounded from above by Aq satisfies K{2) < Aon^/4. 

We use this result to establish the convergence of HK systems with closed-minded 
agents. Note that the convergence is asymptotic. This is even true for n = 2 with a 
single closed-minded agent. Indeed, if the mobile agent is initialized close enough to the 
closed-minded one, it will eventually converge to it by halving its distance at each step. 
The network Gt becomes hxed in this case. In general, it changes with time, however. 
Interestingly, hxed-point attraction does not automatically imply the convergence of the 
communication network, so we address this issue separately. 

Theorem 1.2. An HK system with any number of closed-minded agents converges 
asymptotically to a fixed-point configuration. The communication network converges for 
all initial conditions if d = 1 and for all initial conditions outside a set of measure zero 
if d> 1. 

The specific meaning of this last clause is that, in dimension two and higher, as long 
as we perturb the closed-minded agents by an arbitrarily small amount at the beginning, 
the communication network Gt will settle to a fixed graph in hnite time almost surely. 
The perturbation is likely an unnecessary artifact of the proof and it would be nice to 
settle this point. The main open problem, however, is to derive an effective upper bound 
on the relaxation time. 

1.2 Anchored HK systems 

An anchored HK system consists of n agents, each one represented by a vector Zk = 
{xk(t),yk). The vector is a combination of a mobile part Xk(t) G and a static part 
l/fc G ; the dimensions d and d' are the same for all the agents. Two agents i and j 
are neighbors if and only if — Zj{t )\\2 < r, where r is a hxed positive constant. At 
each step, the mobile part of an agent moves to the mass center of all its neighbors while 
its anchored part remains hxed. (Note that the averaging is done one coordinate at a 
time, so the static coordinates ahect only the neighborhood relationships and do not 
participate in the averaging itself.) Anchored HK systems capture a notion of partial 
closed-mindedness: agents are closed-minded in some coordinates but open-minded in 
others. Both mobile and anchored parts, on the other hand, ahect the communication 
network. 

By contrast, a symmetric heterogeneous HK system consists of n agents, each one 
represented by a vector Xk(t). For each pair of agents (f, j), a threshold rtj specihes that 
agents i and j are neighbors at time t whenever \\xi(t) —Xj(t )\\2 < rij. It is required that 
rtj = rji and ru > 0 (the latter to create self-loops). Note that rtj = 0 means that i and 
j are neighbors only when their positions coincide, while rtj < 0 implies that i and j 


3 



are never joined together. Surprisingly, anchored and symmetric heterogeneous systems 
are conjugate: in other words, there exists a bijection between them that respects their 
dynamics and establishes the equivalence of the two systems. Specihcally, we prove the 
following: 

Theorem 1.3 Given any anchored HK system Zk{t) = {xk{t),yk) in x there 
exists a conjugate symmetric heterogeneous HK system x'j^{t) in M'^. Conversely, a sym¬ 
metric heterogeneous HK system of n agents in is conjugate to an anchored HK 
system Zkit) = {xk{t),yk) with agents in x In both cases, the conjugacy is 

formed by the trivial correspondence: x^it) = x'^{t) for any k and t. Both anchored and 
symmetric heterogeneous HK systems converge asymptotically to a fixed configuration. 
If there is no pair of agents {i,j) such that \\yi — yj \\2 = r in an anchored HK system 
or such that Vij = 0 in a symmetric heterogeneous HK system, then the communication 
network converges to a fixed graph. 

While the convergence of symmetric heterogeneous HK systems can be inferred di¬ 
rectly from known results, the convergence of the communication networks requires 
special treatment, however. An interesting corollary of these results is the convergence 
of HK systems embedded within a social network [2^ |23l [28] . Imagine that the exis¬ 
tence of an edge between two agents i,j is a function not only of their relative distance 
but also of a predetermined, hxed relationship. By setting rij < 0, we can enforce the 
absence of an edge. In this way we can restrict the HK action to the edges of a hxed, 
arbitrary social network, and still assert convergence. 


2 Inertial HK Systems 

The purpose of this section is to prove Theorem ll.il To do that, we assign each agent i 
a certain amount of “money” C'j(O) at the beginning {t = 0) and specify a protocol for 
spending and exchanging it with other agents as time progresses. If we knew ahead of 
time the total contribution of agent i to the kinetic 2-energy, we could simply set C'i(O) 
to that amount and let the agent “pay” for its contribution from its own pocket. This 
information is not available, however, so we take an initial guess and set up an exchange 
protocol so that no agent runs out of money. By giving money to their neighbors in a 
judicious manner, we show how each agent remains in a position to pay for its share 
of the 2-energy at each step. The proof is algorithmic: it is a message-passing protocol 
that simulates the update of a distributed Lyapunov function. Our initial guess is 

n 

C*(0) = ^minj ||xi(0) - Xj{0)\\l, 11. 

i=i 
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To specify the exchange protocol, we hrst simplify the notation as follows: 


r Aj = Xi{t +1) - Xi{t) 

< dij = Xiit) - Xj{t) 

[ = Xi{t + 1) - Xj(t + 1). 

The two rules below are applied to every agent i at any time step t >0: 

• For every neighbor of j at time t (which includes i itself), agent i spends || Aj+Aj ||2 
units of money and gives to agent j an amount equal to 2{dij — Aj)'^Aj. 

• If agent j becomes a new neighbor of i at time f + 1 or, conversely, ceases to be 
one, then agent i spends |||d(j ||2 — 1|- 

Let Ci(t) be the amount of money held by agent i at time t, and let A*"' (resp. 
denote the set of agents that are neighbors of i at time f + 1 (resp. t) but not at time t 
(resp. f + 1). Using the symmetry of the neighbor relation, we express the cash flow at 
time t by 

j&Ni j&Ni 

~ IIMqll2“l|- 

j&Ni 

Since {dji - AiYAi - {dij - AjYAj = dJj{Ai - Aj) - 2dJjAi + ||Aj||^ - ||Ai||^ and, 
by ([ID, A J2jeNi dij = -|Aj|Ai, we have 

a{t + l)-a{t) 

= ^{24(A,-A,) + ||A.-Aj||^-44A.}-4|/V,|||A,||=- ^ III 4 II 2 -II 

jeNi 

= 5;{2<iyA.-A,) + ||Ai-A,||i}+4(A-'-l)|/V.|||Ai||2- - 1 

jeNi 

Note that A = 0 implies that Aj = 0, so it is understood that (A“^ — l)|Aj|||Aj ||2 = 0 
in the identity above. Since d[- = dij + Aj — A^, the hrst summand in the last equality 
above is equal to ||dL ||2 — Hdj^Hl; therefore 

Cjt + 1 ) - C,(t) 

j&Ni 

n n 

= ^min{ \\d'ij\\l,l} - 5^min{ ||di^||2,1 } + 4(A-^ - l) | Aj| || AjU^. 
i=i i=i 
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Since |A^j| > 0 and A < Aq, it follows that 

n t—1 

Ciit) > ^niin{ ||dij||2,l }+4(Ao^ - l) ^ ||a;i(fc +1)-Xi(fc)||2. 

j=l k=0 

Being its own neighbor, agent i spends at least 4|| Aj||| money at each step. Summing up 
over all the agents, this amounts to AK{2). This shows that the initial injection of money 
allows the system to spend AK(2) and still be left with 4(Ao^ — l)i^(2). Theorem 11.11 
follows from the fact that the initial injection of money is at most n^. □ 


3 HK Systems with Closed-Minded Agents 

This section proves Theorem 11.21 The bound on the kinetic 2-energy shows that the 
system eventually slows down to a crawl but it falls short of proving convergence. Indeed, 
an agent moving along a circle by 1/t at time t contributes hnitely to the kinetic 2- 
energy yet travels an inhnite distance. We prove that HK systems with closed-minded 
agents always converge asymptotically. We treat the one-dimensional separately for two 
reasons: the proof is entirely self-contained and the convergence of the communication 
network does not require perturbation. In dimension two and higher, we prove that the 
agents always converge to a hxed position: the system has a hxed-point attractor. We 
show how a tiny random perturbation ensures that the network eventually settles on a 
fixed graph. 

3.1 The one-dimensional case 

We begin with the one-dimensional case, which is particularly simple. By Lemma 11.11 
we can choose a small enough e > 0 and an integer large enough so that no agent 
moves by a distance of more than £ at any time t > ti,. Fix t > and let Xi (resp. W) 
denote the position (resp. neighbors) of agent i at time t; we use primes and double 
primes to indicate the equivalent quantities for time t + 1 and t + 2. The symmetric 
difference between W and N-, if nonempty, is the disjoint union of a set Lj of agents 
located aX Xi — 1 ±0{e) at times t and t + l and a set Ri at locations XiRl±0{e). For 
each subset, we distinguish between the agents of W not in N[ and vice-versa, which 
gives the disjoint partitions Li = L®"' U and Ri = i?®” U The locations x'i and 
x'l of agent i at times t + l and t + 2 are given by 

f = ( '^jeNiCiNf ) 

\ \^i \^i — ( ) + ( 'l2j£L+UR+ )• 
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All x'^ and x'l are of the form Xk ± 0(e:), so subtracting the two identities shows that 

m\-m)x. = {\Lr\- \Lr^\){x. -1) 

+ {\Rr\-\R^^^\){x, + l)±0{en). 

Since the dynamics is translation-invariant, we can assume that Xi = 0. Setting e small 
enough, the integrality of the set cardinalities implies that the net flow of neighbors on 
the left of agent i is the same as it is on the right; 

_|_/^^^| _ 1I_1I (^2^ 

Among all the agents undergoing a change of neighbors between times t and t + 1, pick 
the one that ends up the furthest to the right at time t + 1, choosing the one of largest 
index i to break ties. We distinguish between two cases: 

1. x[> Xi- No agent of can be closed-minded; nor can it be mobile since, ranks 
being preserved, it would provide an agent undergoing a change of neighbors and 
landing to the right of i at time f -|- 1, in contradiction with the dehnition of h It 
follows that is empty, which in turn implies that L*" is not, since by our choice 
of i not all four terms in ([2]) can be zero. Since agent i is not moving left, neither 
is any agent j of Its set Nj of neighbors changes between time t and t-|- 1 and 
j^out jg empty. To see why the latter is true, we hrst note that Nj cannot lose any 
closed-minded agent to the right. Also, since any mobile agent in is to the 
left of i at time t, it stays to the left of it by conservation of ranks; hence the agent 
remains a neighbor of j, a contradiction. The argument so far uses the rightmost 
status of agent i only to assert that is empty. This means we are back to 
square one and we can proceed inductively, eventually reaching a contradiction. 

2. x' < xf. The key observation is that our previous argument never uses time 
directionality, so we can exchange the role of t and t + 1, which implies that now 
x' > Xj. Note that the superscripts in and out must be swapped. While we chose 
i as the mobile agent landing furthest to the right, by symmetry we must now 
choose the one starting the furthest to the right: of course, since mobile agents 
can never cross this make no difference. 

We conclude that each agent is now endowed with a hxed set of neighbors, so the 
dynamics is specihed by the powers of a hxed stochastic matrix with positive diagonal, 
which are well known to converge. The system is attracted to a hxed point at an 
exponential rate, but of course we have no a priori bound on the time it takes to fall 
into that basin of attraction. The communication network converges. 

3.2 The higher-dimensional case 

Generalizing the previous argument to higher dimension fails on several counts, the most 
serious one being the loss of any left-right ordering. We follow a diherent tack, which 
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begins with a distinction between two types of agents. An agent is trapped at time t 
if there exists a path in the current communication graph leading to a closed-minded 
agent; it is said to be free otherwise. There exists a time to after which the agents fall 
into two categories: some of them are never trapped past to and are called eternally free] 
the others are chronically trapped (ie, trapped an inhnite number of times). As we did 
before, we pick a parameter e > 0 (to be specihed below) and te > to large enough so 
that no agent moves by a distance of more than e at any time t > t^- If two agents ever 
get to share the same position, their fates become completely tangled since they can 
never again get separated. Since such merges occur fewer than n times, we can make 
tg big enough, if necessary, so that all merges are in the past. To summarize, past 
the mobile agents move by increments less than e, no merging occurs, and the system 
consists only of eternally free and chronically trapped agents. 

At any time, the state system is represented by a n-hy-d matrix whose i-th row 
encode the position of agent i in The matrix consists of two parts: x for the mobile 
agents and y for the closed-minded ones. A transition of the system is a linear map of 
the form x t-4 Ax + By, where each row of the nonnegative matrix {A \ B) sums up to 1. 

Lemma 3.1. Past te, no agent can move while free. 

Proof. Fixt >te and consider a connected component C of the graph induced by the free 
agents. If denotes its position matrix at time t and k its number of rows, then z' = Cz, 
where primes refer to time t -|- 1 and C* is a k-hy-k stochastic matrix for a random walk 
in the undirected graph C. Because the graph is connected, the eigenvalue 1 of C is 
simple, so the null space of / — C, and hence of (/ — C)^(/ — C), is spanned by 1. By 
Courant-Fischer, therefore, any vector u normal to 1 satishes ||(/ — C)u \\2 > o'||m|| 2 , 
where a is the smallest positive singular value of / — C*. If we dehne ^ — ^11^;^, it 

immediately follows that 

< 11(1 - C)z \\2 = ||(/ - C)z \\2 = \\z - z '\\2 < ey/n. 

Setting e < \af yjn ensures that any two of the k agents are within unit distance. It 
follows that C is the complete graph and C = Since the agents can no longer 

merge, the only option left is for all k of them to be already merged at time t, hence 
unable to move. □ 

The lemma implies that eternally free agents can never move again past te. Indeed, 
it shows that an eternally free agent can only move if it is joined to a trapped one, 
which, by dehnition, it cannot be. Since eternal freedom keeps the agents from playing 
any role after time te, we might as well assume that all the mobile agents in the system 
are chronically trapped. This means that, at all instants, either an agent is trapped (ie, 
joined to a closed-minded agent via a path) or it is isolated, meaning that the other 
agents are either merged with it or at distance greater than one. An agent cannot move 
while isolated. 



The position matrix z of the k trapped agents at time t > satishes the relation 
z' = Tz + Uy, where primes denote time t + 1 and the k-hj-n matrix (T | U) has each row 
summing up to 1. Being trapped implies that U is not the null matrix. In fact, viewed 
as a Markov chain, the trapped agents correspond to transient states, which means that 
tends to the null matrix as k goes to inhnity. This shows that T cannot have 1 as 
an eigenvalue; therefore J — T is nonsingular. Let p be a uniform upper bound on the 
singular values of all the (so-called fundamental) matrices (/ —T)“^; since their number 
is hnite, so is /i. Since z' = Tz + Uy and \\z' — z \\2 < S\/n, the matrix z is very close to 
{I — T)~^Uy; specihcally, 

Ik - - T)~^Uy \\2 = ||(/ - T)-\z - z ')\\2 < y\\z - z '\\2 < ye^/n. (3) 

A matrix of the form (J — T)~^Uy is called an anchor. Since the set of all possible 
anchors (for given y) is hnite, the minimum (Frobenius-norm) distance r between any 
two distinct anchors is strictly positive. The value of r does not depend on e, so we can 
always lower the value of the latter, if necessary, to ensure that r > (1 -f 2y)e\/n. 

By ([3]) and Lemma 13.11 we know that, at any time t past any mobile agent is 
either stuck in place (if free) or at distance at most ysy/n away from an anchor. As 
a result, no agent can ever change anchors since this would necessitate a one-step leap 
of at least r — 2fiey/n > e^/n for the positional matrix, hence the displacement of an 
agent by a distance of at least e, which has been ruled out. Since the argument holds 
for any £ small enough, each mobile agent is thus constrained to converge toward its 
chosen anchor. This concludes the proof that all agents converge to a hxed point in 
The convergence is asymptotic and no bound can be inferred directly from our analysis. 

The result does not imply that the communication network should also converge 
to a hxed graph. The lack of convergence points to a situation where the agents are 
still moving in increasingly small increments, yet edges of the network keep switching 
forever. This can only occur if at least one pair of anchor points are at distance 1: by 
anchor point, we mean the points formed by any row of an anchor matrix or of y. The 
key observation is that all the anchor points are convex combinations of the rows of y, 
so an interdistance of 1 is expressed by an equality of the form |ln ^|/||2 = 1. There are 
only a hnite set of such equalities to consider and each one denotes an algebraic surface 
of codimension 1. Any random perturbation of the closed-minded agents will result in 
the convergence of the communication network almost surely. This completes the proof 
of Theorem 11.21 □ 

4 Anchored and Symmetric Heterogeneous HK Sys¬ 
tems 

This section proves Theorem 11.31 We begin with a proof of the conjugacy between the 
two types of HK systems. 
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4.1 The bijection relation 

To express an anchored HK system z{t) = {xkit),yk) as a symmetric heterogeneous one 
is straightforward. We have the equivalence 

\\zi{t) - Zj{t)\\l <r^ ^ \\xi{t) - Xj{t)\\l <r^ - \\yi - yj\\l. (4) 

We dehne = \/r^ — \\yi — yj\\l if the right hand side of (jl]) is non-negative, and 
Tij = —1 otherwise. Then the system Xk{t) together with thresholds Vij forms a sym¬ 
metric heterogeneous HK system. Notice that the equivalence (jl]) ensures that the com¬ 
munication graphs of the given anchored HK system and its corresponding symmetric 
heterogeneous HK counterpart are identical. 

For the other direction, we need to lift the given symmetric heterogeneous HK system 
to an anchored HK version. We need the following lemma, whose proof can be found in 
the Appendix. 

Lemma 4.1. For any n-hy-n symmetric matrix R = (r^) with no negative terms in the 
diagonal, there exist r > 0 and vectors yk G (1 < ^ < n), such that 

WVi - Vjh = rfj sign{rij), (5) 

for any i ^ j; here sign{x) = 1 if x >0 and —1 otherwise. 

Given a symmetric heterogeneous HK system Xk{t), we choose the anchors yk by 
appealing to Lemma [4.11 For any > 0, it then follows that 

\\xi{t) - Xj{t)\\l < 4 ^ \\xi{t) - Xj{t)\\l + \\yi - yjWl < (6) 

and for any < 0, and we always have 

\\xi{t) - Xj{t)\\l + \\yi - yjWl > ( 7 ) 

for any i ^ j, which prevents any edge between i and j. This means that the dynamics 
of the symmetric heterogenous HK system coincides precisely with that of the mobile 
part of the lifted anchored system. 

Remark: Lemma 14.11 asserts that, given (n — l)n/2 lengths dij {i ^ j) of the form 
(r^ — r'^j sign(ry))^A^ can hnd n points yk G such that the pairwise distance 

WUi — VjlU = dij. Notice that, if dij itself is arbitrary, this is not always possible. For 
example, in the case n = 3, the problem is equivalent to hnding a triangle in with 
each side length given. The problem is solvable if and only if the three lengths satisfy 
the triangle inequality. In our case, however, there is an extra parameter r that we can 
use. Intuitively, if we choose a large r such that all the \rij\ are relatively small, then 
the problem of hnding yk is equivalent to hnding an almost regular polytope, each edge 
of which is roughly of the same length r. 
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4.2 Proof of convergence 


The fixed-point attraction of symmetric heterogeneous HK systems can be inferred di¬ 
rectly from known results about infinite products of type-symmetric stochastic matri¬ 
ces 0 ini dal [ig. The same holds of anchored systems. In both cases, given any e > 0 
and any initial condition, the n agents will eventually reach a ball of radius e that they 
will never leave; we call this e-convergence. We study the conditions for this to imply 
that the corresponding communication networks themselves converge to a fixed graph. 
It suffices to consider the case of a symmetric heterogeneous HK system. Consider a 
connected component C of the graph and let z and z' = Cz denote the corresponding 
position matrices at time t and t 1, where C is the corresponding k-hj-k stochastic 
matrix associated with C. As we did in the proof of Lemma 13.11 we define a to be a 
uniform lower bound on any positive singular value of / — C for any such matrix C. 
Setting 



min r,-,- 

rij>0 


implies that 


I -II 1 II / r -II 1 II /II 1 

F 2 < - K-f - 2 = -\\z - 2 <-< 77 mm rj,-, 

a a a 2 rij>o 


where z = z — is the projection of z onto the orthogonal space of 1. It follows 

that, for any pair {i,j) in C such that > 0, there will be an edge between i and j. 
With the assumption Vij ^ 0, the communication graph is now fixed and convergence 
proceeds at an exponential rate from that point on. The bijection result of the previous 
section shows that the condition = 0 corresponds to \\yi — yj \\2 = r in the case of 
anchored systems. This concludes the proof of Theorem 11.31 □ 
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Appendix 

Our proof of Lemma 14.11 relies on two technical facts. For convenience, we use bold 
letters to denote vectors; for example, Uk denotes the k-th coordinate of vector u. 


Fact A. There exist n+1 vectors G M"" (0 < fc < n) such that — u ^^^\\2 = 1 
{0 < i < j < n), = 0 for i > k > 0 and all exceed l/\/2 and decrease as k 

grows. 

Proof. Proceeding by induction, we write = 0, = ei and = |ei + ^ 62 , 

where is the unit vector in the Fth dimension. Assume we already constructed 
{0 < k < m < n) such that = 0 for z > fc and > l/\/2. Then we can write 


as 


We dehne 


fc = 1 , 2 ,..., m. 


i=l 


m—1 


U 


(m+l) _ 


+ (w 


_ 


2=1 


z, Um 


+ W 1 


4(u<?y 


^m+l- 


Since Um > l/^/ 2 , we have 


ntrd>-ll 


,/ 2 ' 


For A; = 0,1,..., m, 

\\u^rn+l) _ ^(A:)||2 ^ ||^M _ .^(fc)||2 ^ = (1 _ 4 ^) + = 1. 

Notice that, for 0 < fc < n. 


-V,.a- 


4(4‘T 

which proves the monotonicity claim. 


< 0 , 


Fact B. For any integer n > 0, there is a positive number 7 depending on n such 
that, for any pj satisfying \1 — tif <7 and tij = tji if) <i < j <n), there exist vectors 
yP) g M"- (0 < fc < n) such that — y ^^'^\\2 = Uj, for 0 < i < j < n. 

Proof. We make repeated use of the matrix inhnity norm. Recall that if M is a p-by-g 
matrix, its inhnity norm is dehned as the maximum absolute row sum of M: 

1 

||M||oo := max^lm^l. 

j=i 


14 











As one would expect of a matrix norm, the infinity norm is submultiplicative: 


||MiV|U < ||M|U||iV||oo, 

for any p-hj-q matrix M and q-hj-r matrix N. We define a constant 

a = 5n+ max ||Cr^||oo, 

l<fc<n ' ' 

where Ck is the k-hy-k matrix whose i-th row consists of the first k elements of the 
vector in Fact A. Note that Ck is lower-triangular and invertible. Let 7 = 0 ;“^". 
The intuition of the proof is that the vectors we are seeking should be close to the 
vectors We build the desired vectors by induction. Let = 0 and 
Then it is obvious that — ^*-^^112 = ^01 and and are close to the vectors 
from Fact A: 

11 ^( 0 ) _ ^i(o)||^ = 0 < 7 , 

\\yW _ - 1 | < 7 < “S- 

Suppose 2 /®, y^^\ ..., have been specihed such that = 0 for i > j, 

|| 2 /«< a ^'7 (0<*<A;-1), (8) 

and 

= tij {o<i<j<k - 1 ). 

We need to show is that there exists a vector y^^^ such that = 0 for i > /c, 

||?/(^) - ^i(^)||oo < (9) 

and 

\\y^^^-y^"^\\2 = tik {o<i<k-i). ( 10 ) 

This last relation is equivalent to 

^ (i/f^ - i/f = (0 < i < /c - 1 ). ( 11 ) 

j=l j=i+l 

By subtracting the equations for 1 < i < k — 1 from the one for i = 0, we get a linear 
system for y := {y[^\ \ ..., |/i!.\)^: 

Ay = b. 

Here the {k — 1) x (k — 1) matrix A is a lower triangular matrix where Aij = {i > j) 
and b is a (/c — 1 ) dimensional column vector where 

= \ ifok - 4 + ^ {yff) ■ 

i=i 
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We derive similar relations from Fact A: 


^ {uf - uf y + {uff = 1 (0 < * < - 1 ), ( 12 ) 

j=l j=i+l 

which implies a linear system for u := {uf^\ ..., 

Cii = d, 

where C is shorthand for Ck-i and dj = | Yl]=i already observed that C is 

nonsingnlar; we note that, by (jH]) and > l/\/2, the same is true of A. Next, we derive 
upper bounds on the length of the vector b and its distance from d. By 11 — f| <7 
and 7 < 1 / 2 , 

\4k -t‘^ik\ = \^ok + tik\\tok -tik\< (2 + 27 ) • 27 < 67 . (13) 

By our induction hypothesis ([ 8 ]), the fact that <1 + 7, and the definition of 7, we 
have 

Thus, by inainil, 

||h - d||oo < 3(1 + (15) 

By inequality ffT3l) and the fact that 7 is small enough, we have 

||h||oo < Kk - tiki + Ily^*^ll2) < ^(67 + (1 + 7 )^) < 1- (16) 

We also claim that 

||A“^ - C"^||oo < 2na'^^~‘^'y. (17) 

Here is why. First, notice that (j 8 ]) implies ||A — CHoo < Then based on the 

definition of a, we have ||C“^||oo < «, and hence 

||C'-'(A - C')|U < ||C'-ioc||A - CIU < (18) 

The right hand side of the above inequality is smaller than 1/2 based on the definition 
of 7, which allows us to expand the matrix inverse [/ + C~^{A — C)]”^ as 

00 

[/ + C-\A - C)]-^ = 1 + ^(- 1 )'[C'-^(A - C)\\ 

i=0 



= < (2 + a"^*7) • a"^*7 < ^^7. (14) 


from which it follows that 


\\[I + C-\A-C)]-^\\^<2. 


(19) 
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Notice that 


A-i - C-^ = [/ + C-\A - C)]-^C-\C - A)C-\ 

then inequality (1T7|) directly follows from inequalities fflSj) and (IT^ . By flT^ [T6l fT7|) and 
the fact that HC^^Hoo < hnally we have 

ll^-ttlloo = \\A~^b-C~^d\\oo 

= \\iA-^-C-^)b + C-\b-d)\\^ 

< ||(A-' - C'-i)||oc||b||oc + r-ioc||(b - d)||oc 

< 2na^^-^-f + 3(1 + /2)a^ < 


This shows that 


Isf 

(l<j<fc-l). 

(20) 

In turn, this implies that 



/ {k)\2 / (k)\2 1 (k) , (fc)ii (fc) (fc), 

[y) ) - [u) ') = \y} + u) ’\\y) -u)’\ 

< (2 + < 3q!^^“^7. 

(21) 


It suffices now to set the remaining (nonzero) coordinate of yet to be specihed, 
which is Recall that it must satisfy 

t =‘h 

i=i 

and, by our construction, this single equality suffices to imply all of flTOj) . This implies a 
unique setting of (positive) so we need only be concerned with ([9]) and the positivity 
of {yk'’T- Since |1 - tl^\ = |1 - tofc||l + ^ofc| < 7(2 + 7 ) < 37, inequality ([12]) for i = 0, 
combined with flTT)) . establishes that 


(j/fT - (h‘7 < E I - Wt'f + 11 - < 3(1 + 




k-l 




(fc)x2 


2=1 


Since > l/\/2, it follows that 


{yf^f > --3(l + na 


4fc-l 


)7 > 0. 


Furthermore, 


bf - ufl = ^(1) i)*) ^ ^ < 3^(1 

yl +ui’ 


+ ^)7 < cA'^1 




( 22 ) 


In conjunction with fl20|) . this establishes ([9]), and completes the inductive construction. 

□ 

It should be noted that Fact B can also be proven via the implicit function theorem 
and a perturbation argument based on Fact A. The beneht of the proof given above is 
to provide an explicit construction. 
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Lemma 4.1 For any n-by-n symmetric matrix R = {rij) with no negative terms in 
the diagonal, there exist r > 0 and vectors y^ G {)- < k <n), such that 

WVi - yjh = (23) 

for any i ^ j; here sign{x) = 1 if x >0 and —1 otherwise. 

Proof. Choose a sufficiently large r such that 

max \rij\ < yr, 

where 7 is the small positive constant from Fact B. We set tij to — rfj sign(rjj)/r^ 

and easily verify that \l — tij\ < 7 . Fact B guarantees the existence of vectors Zk G 
{I < k < n) such that \\zi — Zj \\2 = tij. Setting y^ = rzk satishes the requirements. □ 


18 



